Audio-Visual Speech Separation and Dereverberation With a Two-Stage Multimodal Network

Speech Separation with Dereverberation-based Pre-processing Incorporating Visual Cues

separation with dereverberation-based pre-processing incorporating visual cues.

Audio-visual and Multimodal Speech Systems

Perceptual Improvement of a Two-Stage Algorithm for Speech Dereverberation

This paper presents three effective proposals for a twostage algorithm for one-microphone reverberant speech enhancement. The original algorithm is divided into two blocks: one that deals with the coloration effect, due to the early reflections, and the other for reducing the long-term reverberation. The proposed modifications consider changing the linearprediction model order, the adaptation s...

Auxiliary Multimodal LSTM for Audio-visual Speech Recognition and Lipreading

The Aduio-visual Speech Recognition (AVSR) which employs both the video and audio information to do Automatic Speech Recognition (ASR) is one of the application of multimodal leaning making ASR system more robust and accuracy. The traditional models usually treated AVSR as inference or projection but strict prior limits its ability. As the revival of deep learning, Deep Neural Networks (DNN) be...

Multimodal Feature Extraction and Fusion for Audio-Visual Speech Recognition

xiii